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Two alternative models for identifying kindergarten age children with 
a high risk of becoming reading fai lures are compared. One model places 
primary emphasis on psychometric test procedures assessing linguistic and 
perceptual-motor skills related to reading readiness. The alternative 
strategy is based upon the kindergarten teacher-s evaluation of the child's 
skills and behavior, with particular emphasis on the discrepancy between 
a child's specific competencies and those required for success in a parti- 
cular first grade classroom. Significant and encouraging correlations 
were obtained between the various measures taken in kindergarten and 
reading achievement test scores obtained at the end of first grade. 
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Previous •©search efforts to develop an effective predictive index 
of reading failure have placed emphasis on the use of psychometric test 
procedures assessing a delimited set of linguistic and perceptual-motor 
skills. The present investigation evaluates and contrasts the major 
psychometric predictive index developed by de Hirsch and her colleagues 
(1966) with that of an alternative strategy we have developed to assess 
the impact of a broader range of key variables which interact in shaping 
School success and failure (Adelraan and Feshbach, 1971). 

The alternative model proposed entails several inter-related com- 
ponents. The predictive efficiency of each of these coniponents and of 
meaningful combinations generated by our overall strategy can be sep- 
arately evaluated and compared with that of more standard psychometric 
procedures such as the de Hirsch battery. The key component is a 
behavioral analysis made by the kindergarten teacher of those cognitive, 
affective and social attributes of the child which, on a largely a priori 
basis, have been judged as relevant to success in various first grade 
reading programs. The kindergarten teachers' ratings of these behaviors 
constitutes the first step in our predictive sequence. The second step 
is an assessment o* the first grade environment to which our kindergarten 
youngster is assigned. There are two modes of analysis which we intend 
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to make of the variations in first grade environments — normative and 
interactive. The normative analysis attempts to Identify characteristics 
of first grade environments which are correlated vith reading achievement 
However, although some teachers and some programs may prove to be more 
effective than others, there is still a great deal of variation in first 
grade environments that may be equivalent with regard to this overall 
success. Some children may thrive in a classroom in which others do 
poorly, while these same children may do poorly in a clacsroom in which 
others are successful • It is this interaction which we propose to ana- 
lyze. In essence, the strategy involves an assessment of the discrep- 
ancy between a youngster's skills and behaviors as manifested in kinder* 
garten and those required for success in a particular first grade class* 
room. 

The uniqueness and strength of this approach lies in (1) the use 
of teacher observations and ratings to assess a broad range of children's 
behaviors over an extended period of time as contrasted to a single test 
session; (2) the similarity between the assessment and criterion settings 
and (3) the effort to take into account variation among first grade pro- 
grams and to deal wfth the interactions between these variations and 
specific competencies the child brings to a particular classroom. 

Subjects and Procedures 

During the spring of the first two years of the project, the kin- 
dergarten children in 10 middle class urban schools, 888 in Year I and 
844 in Year II, were administered the Wechsler Preschool and Primary 
Scale of Intelligence (WPPSI) , the Otis-Lennon group intelligence test 
and the de Hirsch predictive index of reading failure (de Hirsch, et al . , 
1966) . Although the revised de Hirsch test battery consisted of 9 sub- 
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tests assessing linguistic and perceptual-motor skills,, an additional 
three sub-tests from the original battery were included in the psycho- 
metric assessment. Also, measures of cognitive style were administered 
to subj^roups in the sample. 

During this same period, kindergarten teachers observed and then 
7:ated their pupils on an instrument developed by us, labeled the Student 
Rating Scale (SRS) . This scale includes items dealing with the chlld^s 
cognitive, affective and social functioning in the classroom. Each item- 
is raced on a 1 to 5 scale, with the lower scores reflecting deficits, 
and the higher scores competencies, in the particular behavior being 
assessed. After revising and refining the instrument, Al items were 
included in the final version. The instrument was then distributed to 
the 32 kindergarten teachers participating in the project, who were 
given an 3 week perlc' in which to observe the indicated behaviors and 
skills. and complete the instrument. 

There are several ways in which the reliability of the instrument 
can be estimated. One of the more critical indices is rater reliability. 
An opportunity to assess rater reliability in a natural context was pro- 
vided by four classrooms which were team taught by teachers who shared 
morning and afternoon kindergarten classes. The inter-rater correlation 
proved to be ,81, a particularly impressive figure in view of the skewed 
nature of the ratings, most children receiving average item scores in 
the upper ranges, between 4 and 5, 

During the 8 week time period in which the teachers were asked to 
observe the children systematically, they also filled out the Kohn Social 
Competence Scale, which is designed to measure the social and emotional 
functioning of the child. This scale has been shown to correlate with 



other indices of psychopathology and, in addition, is related to the 
child's subsequent reading achievement • For the. purposes of the pre- 
sent paper, the results obtained for the two factors of the Social Competence 
Scale: 1) Interest-Participation vs, Apathy-Withdrawal ^nd II) 
Cooperation-Compliance vs, Anger-Defiance — are of particular interest. 

Concurrent with the assessment of each kindergartener's behavior 
and cognitive functioning, an appraisal was made of the first grade 
environments. Observers, who were placed in the classroor?, scored the 
frequency of specified Interactions and, in addition, described parti- 
cular classroom procedures. These data are still in the process of 
analysis, A second procedure entailed having each first grade teacher 
rate behavior and skill items which parallel those included in the Stu- 
dent Rating Scale. The first grade teachers rated how important specific 
skills and behaviors were to success in t. ir classrooms and how fre- 
quently such skills and behaviors were reqi.[red. The data permit an 
analysis of both the normative and idiosyncratic aspects of behavioral 
and skill demands made by first grade teachers* 

When the children who had been tested and rated in kindergarten 
were near the end of the first grade, a number of criterion measures 
were obtained. The key measures are standardized reading achievement 
tests - the Cooperative Primary Reading Tests and the Comprehension part 
of the Gates McGinitie Reading Test-Primary A, as well as a systematic 
behavior and skills evaluation of each child on the Student Rating Scale 
by the first grade teacher. Additional measures to be used as criterion 
data include a sample of the child's composition work using a standard 
topic, and an appraisal of performance in other academic areas. Com- 
parable criterion data will also be obtained at the end of the second 
and third grades. 
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Resul ts 

The findings presented here are restricted to specific sets of 
data collected in connection with Year l^s kindergarten sample. (The 
first ^rade criterion data on Year Il's kindergarteners, V7ho ^.re intended 
as "a replication sample, are still being collected.) We will be con- 
cerned with two types of information. The first pertains to the inter^ 
relationships among the various measures obtained on the kindergarten 
children, with a specific focus on the Student Rating Scalo - its factorial 
structure and its shared variance with and independence of I.Q., the de 
hirscii battery and the Koiin Scales. The second category of data bears 
on the predictive validity of the Student Rating Scale and the de Hirsch, 
recognizing the limitations of being restricted, for the present, to 
first grade performance criteria. 

With regard to the Student Rating Scale, a factor analysis yielded 
five factors. These, in descending order of the amount of variance ex- 
plained, were readily labeled as I) Impulse Control or Classroom - 
Behavior, II) Verbal Ability and' Language Development, III) Perceptual 
Discrimination, IV) Recall, and V) Perceptual^Motor skills. The inter- 
correlations of these factors with the other kindergarten sample variables 
are presented in Table 1. (For this purpose, a Z~score transformation 
of each child^s factor score was made, based upon th^ child's relative 
position in his or her class.) Although the factors relate similarly 
to some variables — such as Performance I-Q., Otis I-Q., de Hirsch 
scores, a number of interesting differences emerge which bear on the 
validity of the labels given to these factors. Compare, for example. 
Factor I, Impulse Control and Classroom Behavior, with Factor II, 
Language Development and Verbal Ability. The Verbal Factor correlates 
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more highly with Verbal I.Q. than does the Impulse Control factor, while 
the Impulse Control factor correlates more highly with the Cooperation 
vs. Defiance factor of the Kohn Scale. It is pertinent that Factor V, 
Perceptual-Motor skills, correlates more highly with Performance I.Q. 
and the Koppitz Scoring of the Bender Gestalt than do any of the other . 
factors. VAiilo these correlations are far from sufficient to establish 
the validity of the factors, the results thus far are supportive. They 
suggest that the teachers ratings reflect more than a simple halo effect 
and indeed do discriminate among different components of the child's 
functioning. 

^ Since the thrust of this report is in the comparison of the de 
Hirsch with the SRS scales, their respective intercorrelat ions are also 
of interest. As one might expect, Student Rating Scale scores are more 
highly correlated than are de Hirsch Scores with the Kohn Social Compe- 
tence rating, botli correlating mor-e strongly with Interest-Witlulrawal 
than with the Cooperatior.-Def iance factor. Their respective correlations 
with each other and witl: the Otis and WPPSI I.Q.'s are s^.rikingly simi^ 
lar, ranging from .46 to .52. 

With this information regarding some of the descriptive character- 
istics of our major pred^-ctive instruments, we now turn to an examination 
of the relationship of these variables with first grade performance 
criteria. The analyses of the behavioral evaluation data and of the 
composition samp lies are still in process, and consequently the presen- 
tation will be restricted to the First Grade Reading Achievement scores. 
The correlations of the Kindergarten measures with the Cooperative 
Primary Reading Test and the Gates M^cGinitie Reading Achievement test 
raw scores and converted Grade Placement scores are presented in Table 2. 
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There are a number of observations of note in this table. First, because 
a child cannot get a grade placement less than 1.0, the Achievement test 
scores are markedly skewed in an upward direction. This is particularly 
the case for tlie Cooperative, on which fully 82% of the sample received 
a ji^rade placement higher than 1.7, the school year and month in which the 
achievement tests were p.iven. The distribution for the Gates was more 
normal, 702 obtaining a grade placement better than 1.7 on this measure. 
Wc? suggest that the better discrimination which the Gates provides at ' 
the lower levels of reading achievement is the principal reason why the 
various kindergarten measures correlate more highly with the Gates than 
with the Cooperative Primary test. 

A second methodological point that warrants comment are the stronger 
correlations obtained when Student Rating Scale Z scores rather than raw 
scores are used. In converting the raw Student Rating Scale scores to 
Z scores, based on within-class means and standard deviation, one is 
essentially equating the means for each of the 32 kindergarten classes. 
Tlie loss in discrimination entailed by assuming equivalence between 
classes is more than balanced by the gain resulting from eliminating . 
error variance due to teacher rating scale biases. 

The correlations of the respective Student Rating Scale Factors 
with the Reading Achievement scores are fairly similar, with the excep- 
tion of Factor III, Perceptual Discrimination, which correlates as highly 
with the criterion measures as does the total Student Rating Scale score. 
Although cross-validation is needed to confirm the suggested greater 
predictive validity of this factor, the finding is all the more striking 
when one considers that there are only four items that load on this 
perceptual discrimination factor. These items pertain to the child 
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ability to discriminate: letters and words visually and auditorily. 

Comparing the SRS correlations and those of. the other predictive 
indices with reading, test scores, we find that respectable correlations 
are attained by the Student Rating„S_cale_s.coxes.,__the- de Hirsch-bat-t-G-r-y-* — 
the Koppit?. Bender score, WPPSI I.Q., Otis I.Q., and Kohn Factor I. 
The lower but significant correlations found between sex and reading 
achievement, reflect the expected better performance by girls on the 
reading measures. The highest correlations obtained are with the total 
SRS* (and SRS Factor III) scores, the de Hirsch battery running a close 
second. The largest difference between the Student Rating Scale and de 
Hirsch measure is in their correlations with the Gates raw score, 
although ijt must be noted that .60 is not significantly greater than .53. 

There are several other bases for comparing the relative predictive 
efficiency of the Student Rating Scale and the de Hirsch battery. A 
stepwise multiple regression analysis was carried out such that the 
contribution of each of the predictive factors could be determined while 
accounting for both correlation with the criterion and independence from 
other predictor variables. The Student Rating Scale emerged consistently 
as the best single predictor while the de Hirsch battery and WPPSI I. Q. 
ranked second and third. Beginning with a .57 correlation with Gates 
grade placement, the addition of the de Hirsch raises the multiple R to 
.63 while adding I.Q. increases the multiple R to only .64. The multi- 
ple correlation when all predictor variables are used is .68, which is 
not very much greater than the Student Rating Scale r of .57. 

In terms of the need to identify children who are potential reading 
failures for the purpose of early intervention, a more relevant datum 
than overall correlation is the efficiency in predicting those children 
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who, by virtue of their falling below a specif: c criterion, can be con- 
sidered reading failures. Although first grade is too early a period 
in which to define reading failure in the clinical sense^ it is useful 
to compare the Student Rating Scale and de Hirsch procedures in terms 
of their ability to identify children who achieve above and below some 
reading norm. For this purpose, we used a grade placement score of less 
than 1*7 aa the defining criterion of ''poor" reading perf or^r ^nce, pre- 
ferring this tern to reading "failure." In addition, eliminated from 
this analysis a' I children with an I.Q. below ^C. 

For the Stadent Rating Scale, we ch:^se a Z score of -1.25 as the 
cutoff point in making our predir*xOns of good and poor reading; perfor- 
mance in first grade. For the de Hirsch, we used a previously established 
cutoff of less than 5 passed, of the 9 subtests^ for predicting probable 
poor performance. These criteria included the bottom 10% on each measure. 
The efficiency of the Student Rating Scale and the de Hirsch in predict- 
ing the failure criterion can be examined in Table 3. Both are about 
75% accurate in their predictions. However, they differ markedly in 
the types of errors made. With the de Hirsch, there are about twice as 
many false positives as when the Student Rating Scale is used. Although 
the proportion of false negatives with either predictor is relatively 
small, the absolute number of false negatives is quite large. There are 
clearly other factors that need to be taken into account if the numbers 
of false negatives are to be reduced. Variations in classroom experiences 
are undoubtedly among these factors. For example, initial analyses of 
these data reveal that first grade teachers ratings of the importance 
of the items in Factor 5, the Perceptual-Motor factor, correlate .39 
With the mean scores obtained by their classes on the Cooperative 
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Achievement tipsc and .43 with the Gates. In future analyses, we intend 
to examine in detail the interactions betv?een a child's deficits as 
inclicaled on the kinder>jarten Student Rating Scale, and the deraands and 
procedures vhicli the cliild experiences in first r^rade. * 

For the present, we are encouraged by the flndinji that a kinder- 
garten teacher's ralihjfS can predict first j^rade reading achievement at 

least as efficiently as a psychometric battery that had been designed 

t 

for this purpose. The results thus far indicate that th*^ aDproach we 
have taken to the early identification of children who have a hi^h rate 
of developing! a reading difficulty is a fruitful one. However, we need 
to await the verdict of cross-validation and of rur ion>z,it\»dinal follow- 
up of these youngsters* performance In the second and late^ grades. 
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Table 2 

CORRELATION OF MAJOR KINDERGARTEN VAR.IABLES WITH 
FIRST C;RiM)E READING TEST SCORES YEAR I SA>U^Ii^ 





COOPERATIVE PRIMARY 


GATES 


MucGINITIE 




Raw Score 


Grade 


Raw Score 


Grade 






Placement 






Placement 


Sex 


•17 


.15 


.23 




.23 


Ago 


.11 


.11 


.05 




.07 


WPPSI Verbal IQ 


.40 


.40^ 


.44 




.43 


WPPSI Pcrf. IQ 


.29 


.26 


.38 




. 37 


WPPSI Full Scale IQ 


.39 


.37 


.47 




.46. - 


Otis (group) IQ 

vo ir/ N. 


.45 


.42 


.50 




.47 


do Ilirsch 


.47 


.44 


.53 




.52 


Koppitz Bonder Erroi' Scoro 


- .29 


- .26 


-.33 




-.33 


Kolin Factor I (InCorost) 


.28 


.26 


.41 




.3 ) 


Kolui FacLor 11 (Corporation) 


.12 


. 13 


.23 




.21 


SRS Factor I 


.32 


.30 


.44 




.42 


" Z- score " 


.37 


. 35 


.47 




.45 


SRS Factor II 


. JJ 




.42 




.40 


11 rj 

Z/-i>COrG. 


.41 


.38 


.50 




.46 


SRS Factor III 


.43 


.39 


.55 




.52 


" Z-score 


.51 


.48 


.60 




.57 


SRS Factor IV 


.31 


.28 


.42 




.40" 


" Z-score 


.41 


.39 


.52 




• .49 


SRS Factor V 


.35 


.31 


.41 




.41 


Z-score 




•^2 


.50 




.•48 


SRS Total 


.41 


.39 


.53 




. .51 


" Z-scorc 




• ^7 


.60 . 




.57 



N - 433 
1- nr. = -JO 



Z-scores are based on within-class mean and s.d. 



Table 3 

PREDICTION OF RE^^t^ING PERP0R>IAK'CE ON GATES -HacGlNITIE 
READING TEST USING S.R.S. AND DE HIRSCH 



A. S.R.S. Aionc: Predicted poor reader if average item score on S.R.S, 

is 1*25 standard deviations belov? classroom mean, 
(bottom 117.) 



good 

GATES'*^ 
poor 



ii 


395 


(177,) 


(76/:) 


34 


125 


(83'Z,) 


(247) 


poor 


good 


S.R.S, ■ 


-1.25 



HITS 
MISSES 
N 



449 (777,) 
136 (237.) 
585' 



B. dc Hirsch Alone: Predicted poor reader' if'4 or fewer tests passed. 
? (bottom 137.) 



I 

good 
GATES-'' 
poor 



28 
(397,) 


374 
(757) 


■ 

44 

(617o) 


126 
(2 57) 



poor good 
de llirsch 4 



HITS 
MISSES 
N 



418 (727.) 
154 (277o) 
572 



C. Joint Prediction: Predicted poor reader if both of above criteria 

are met (bottom 67) 



good 
GATES'"- 
poor 



5 

(157o) 


396 
(74%) 


HITS : 


424 


(747o) 


28 ■ 


142 


MISSES: 


147 


(267o) 


(857o) 


(267o) 


N: 


571 




poor 


good 








S.R.S . 


-1.25 and 


de Hirsch 4 







"Criterion for poor performance on Gates: grade placement score of 1.7 or below. 
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